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METHOD FOR DRXVINO MULTIPLE APPLICATIONS BY A COMMON DIALOG MANAGEMENT 



This invention relates in general to a method for driving multiple 
applications by a common, at least partially speech-based, dialog management system 
and to a dialog management system for driving multiple applications. 

Recent developments in the area of man-machine interfaces have led to 
widespread use of technical devices or applications which are managed or driven by 
means of a dialog between an application and the user of the application. Most dialog 
management systems are based on the display of visual information and manual 
interaction on the part of the user. For instance, a user can enter into a dialog or dialog 
flow with a personal digital assistant in order to plan appointments or read incoming 
mails. The dialog can be carried out by the dialog management system issuing prompts 
to which the user responds by means of a pen or keyboard input. Such an application 
can be requested by the user to report events which are occurring or which will occur in 
the near future. For exan^>le, the personal digital assistant can remind the user of an 
upcoming appointment or important date. The reminder might be graphically presented 
on a display, and accompanied by an audible reminder such a beep, ping or similar 
artificial sound, to attract the user's attention and remind him look at the display to see 
the message or reminder conveyed by the application. The same type of beep or ping 
might be used as a general attention-getting device, or several different types of sound 
might be used to indicate different types of events. Such a beep is commonly referred to 
in a play of words as an "earcon", being the audible equivalent of an icon. 

As long as such a dialog is carried out between the user and only one 
application, it is not particularly difficult to remember which earcon or beep is 
associated with which event. However, if the dialog management system is managing 
the dialog between a user and a number of applications, it can become quite confusing 
since the sounds used to indicate the various types of events are generally limited to 
beeps and other artificial sounding electronic noises. The user might be confused and 
mistake one type of soimd for another, thereby misinterpreting the dialog flow. 
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An at least partially speech-based dialog management system however 
allows a user to enter into a one-way or two-way spoken dialog with an application. 
The user can issue spoken commands and receive visual and/or audible feedback from 
the dialog system. One such example might be a home electronics management system, 

5 where the user issues spoken commands to activate a device e.g. the video recorder. 
Another example might be the operation of a navigation device or another device in a 
vehicle in which the user asks questions of or directs commands at the device, which 
gives a response or asks a question in return. More advanced dialog management 
systems can issue spoken prompts and interpret spoken user input. For example, if the 

10 user wishes to check the status of his electronic mailbox, he might say "Check my 
mailbox", and the dialog management system, after forwarding the necessary 
commands to the application and interpreting the result reported back, might reply 
"YouVe got mail" or "Mailbox is empty" as appropriate. However, such spoken 
feedback can be irritating, even when limited to terse phrases, especially if the dialog 

15 management system is driving a nimiber of applications sunultaneously. For example, if 
the dialog management system is controlling the dialog between a personal digital 
assistant, a personal computer, a telephone, a home entertainment system and a news 
and weather service, the user might be continually bombarded with speech feedback 
like "Incoming call from Mr. So-and-so", "Weather is set to stay fine", "The match 

20 between Bayem Munchen and Real Madrid is due to start in 5 minutes on channel XYZ 
- shall I record it?", "Check-up due at dentist in the next two weeks - do you want an 
appointment?" and "Internet coimection timeout after 5 minutes", etc. etc. The user 
might be eventually driven to distraction by the volume of messages being output, even 
though the messages are relevant and the information has been specifically requested. 

25 An attempt at providing a dialog management system which informs the 

user of the status of an application via auditory icons as an accompaniment to speech 
feedback has been made in "Contextual Awareness, Messaging and Communication in 
Nomadic Audio Environments" from Nitin Sawnhey, M, SC. Thesis, Massachusetts 
Institute of Technology, 1998. This draft describes a portable device which is able to 

30 interface to a remote server. The status of one or more programs active on the server 
can be reported by the portable audio device, typically worn on the user's l^el. This 
device is limited to receiving messages only from different programs running on this 
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remote server and to monitoring the activity of these programs — all of a similar nature 
- so that these can in effect be regarded as a single application. Actual driving of 
numerous separate applications, even of differing natures, by a common dialog system 
wherein the user can not only monitor but also control these different applications, is 
5 not foreseen ia this draft. 



Therefore, an object of the present invention is to provide an easy and 
inexpensive method for ensuring comfortable and uncomplicated distinction by the user 
10 between different applications with which he is interacting using a common dialog 
management system and in particular to ensure that the user will not issue a command 
intended for one application to another by mistake 

To this end, the present invention provides a method for driving 
numerous appHcations by a conmion dialog management system where a unique set of 
1 5 auditory icons is assigned to each appUcadon, and where the common dialog 

management system informs a user of the status of an application by audible playback, 
at a specific pomt in a dialog flow, of a relevant auditory icon selected from among the 
unique set of auditory icons of the appUcation. An "auditory icon" can be any type of 
sound or dedicated sound chunk used to describe a particular type of feedback from the 
20 application, such as an artificial short sound chunk (earcon) or a sound chunk 
resembling a real-world sound, such as a recording of a relevant sound. 

A dialog management system according to the invention comprises an 
input detection arrangement for detecting user input to the system, a sound output 
arrangement for outputting audible prompts, a core dialog engine for coordinating a 
25 dialog flow by mterpreting user input and generating output prompts, an appUcation 
interface for communication between the dialog management system and the 
applications, a source of unique sets of auditory icons assigned to the applications, and 
an auditory icon management unit for selecting relevant auditory icons from tiie unique 
sets of auditory icons corresponding to the applications for playback at appropriate 

30 points in the dialog flow. 

Using a dialog management system according to the present invention to 

drive numerous applications, die user can easily distinguish between flie different types 
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of feedback from the different applications. Since each type of feedback reported back 
from an application is accompanied by a unique meaningfiil audible sound, easily 
associated by the user with the corresponding application, the user does not run the risk 
of becoming confused, and will not mistake one type of feedback with another. The 

5 unique auditory icons keep the user constantly informed about the application with 
which he is currently interacting. This ensures that the user cannot issue a command 
intended for one application to another by mistake. The invention is therefore 
particularly advantageous for a exclusively speech-controlled dialog management 
system, or in an application where it is impracticable or dangerous for the user to have 

10 to look at a screen to follow the dialog, such as an automobile navigation system where 
the user should not be distracted from concentrating on the traffic, or a computer-aided 
surgical procedure, where the surgeon must remain focussed on the operative procedure 
taking place while being constantly informed of the status of the procedure. The 
invention therefore allows numerous separate applications, even of differing natures, to 

15 be driven by a common dialog system and to be monitored and controlled by a user. 

The dependent claims disclose particularly advantageous embodiments 
and features of the invention whereby the system could be further developed according 

to the features of the method claims. 

A dialog management system according to the present invention might 

20 be incorporated in an already existing device such as a PC, television, video recorder 
etc., and might inform the user of the status of various applications running in a home 
and/or office environment. In a preferred embodiment, the dialog management system 
is implemented, as a stand-alone device, with a physical aspect such as that of a robot 
or preferably a human. The dialog system might be realised as a dedicated device as 

25 described, for example, in DE 10249060 Al, constructed in such a way that a moveable 
part with schematic facial features can turn to face the user, giving the impression that 
the device is listening to the user. Such a dialog management system might even be 
constructed in such a fashion that it can accompany the user as he moves fi-om room to 
room. The interfaces between the dialog management system and the individual 

30 applications might be realised by means of cables. Preferably, the interfaces are realised 
in a wireless manner, such as infra-red, bluetooth, etc., so that the dialog management 
system remains essentially mobile, and is not restricted to being positioned in the 
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vicinity of the applications which it is used to drive. If the wireless interfaces have 
sufficient reach, the dialog management system can easily be used for controlling 
numerous applications for devices located in different rooms of a building, such as an 
office block or private house. The interfaces between the dialog management system 

5 and the individual applications are preferably managed in a dedicated application 
interface unit. Here, the communication between the applications and the dialog 
management system is managed by forwarding to each application any commands or 
instructions interpreted from the spoken user input, and by receiving from an 
application any feedback intended for the user. The application interface unit can deal 

10 with several applications in a parallel manner. 

An application driven by the dialog management system might be a 
program running as software on a personal computer, a network, or any electronic 
device controlled by a processor or simple circuitry, such as a heating system for a 
household, a microwave oven, etc.. Equally, an application can be understood to control 

15 a mechanical or physical device or object not ordinarily controlled by a processor. Such 
a device or object might be a purely mechanical device or object such as, for example, a 
letterbox. Such an object might be provided with appropriate sensors and an interface to 
the dialog management system, so that the dialog management system is informed 
when, for example, letters are dropped into the letterbox. This event might then be 

20 communicated to the user by an appropriate auditory icon, such as a post horn sound. 
The user of the dialog management system can thus tell whether he has received a 
postal delivery without having to actually go and see. Such an application of a dialog 
management system according to the invention might be particularly advantageous for a 
user living in a high-rise apartment block, or for a physically disabled user. A heating 

25 system, such as the household type of heating system that can be re-programmed by the 
user according to season, might be controlled by dialog management system according 
to the invention. The user might avail of the dialog management system to easily 
reprogram the heating system by means of spoken commands before gomg on vacation, 
thus being spared the necessity of a time-consuming manual reprogramming. The 

30 dialog management system can report the status of the heating system to the user , 

whereby the relevant prompts may be accompanied by appropriate auditory icons. An 
application can also be understood to be an essentially electronic device such as an 
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intercom or telephone. Here, the dialog management system could be connected to the 
intercom or telephone by means of a suitable interface, and can assist the user in 
dealing with a visitor or an incoming call by informing the user of the event by emitting 
an appropriate auditory icon — for example the sound of knocking on wood for a visitor 
5 at the door - without the user actually having to first open the door or pick up the 
telephone receiver. 

User input to the dialog management system can be vocal, whereby 
spoken commands or comments of the user are recorded by means of the input 
detection arrangement, for example, a microphone. The input detection arrangement 

10 might - if the dialog management system is not exclusively speech-controlled - 

additionally comprise a keyboard, mouse, or a number of buttons by means of which 
the user can input commands to the system. An advanced input detection arrangement 
might even feature cameras for sensing movement of the user, so that the user might 
communicate with the dialog management system by means of gestures, for example by 

15 waving his hand or shaking his head. The dialog management system interprets the 
user input, determines the appUcation for which the user input is intended, and converts 

4 

the user input to a form suitable for understanding by that application. 

Spoken user input is analysed for content, and feedback from the 
application is converted to an output prompt by a core dialog engine. The dialog 
20 management system communicates with the user by means of a sound output 

arrangement, preferably one or more loudspeakers, for outputting audible prompts 
which are generated by the core dialog engine in response to feedback from an 
application. 

The core dialog engine comprises several units or modules for 
25 performing the usual steps of speech recognition and speech synthesis, such as an 

language understanding unit, a speech synthesis unit etc. A dialog control unit interprets 
the text identified by the language understanding unit, identifies the application for 
which it is intended, and converts it into a form suitable for processing by that 
application. Furthermore, the dialog control imit might analyse incoming feedback from 
30 an application and forward a suitable auditory icon, chosen from the unique set of 
auditory icons associated with that application, to the output sound arrangement. The 
audible prompts comprise auditory icons, which are understood to be dedicated sound 
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chunks describing a particular type of feedback from an appUcation. 

The auditory icons are used by the application to indicate any event 
during the dialog flow, or that a particular event has occurred - probably of interest to 
the user -such as the arrival of an electronic mail. Furthermore, the auditory icons 

5 might be used to indicate that an application is awaiting a user response, for example if 
the user has overheard a prompt. Auditory icons are preferably used to indicate any 
change in operational status of an application about which the user should be informed. 

An application might feature a complete set of auditory icons for use in 
any situation where the application can give the user feedback concerning its status or 

10 activities. In a preferred embodiment of the invention, an application might supply the 
dialog management system with a copy of its set of auditory icons, along with any 
associated instructions or accompanying information regarding the suitable use or 
playback of each auditory icon. These icons are managed by the dialog management : 
system in an auditory icon management unit, which keeps track of which auditory icon 

15 is assigned to which application, and the type of feedback for which each auditory icon 
is to be used. The dialog management system might acquire the complete set of 
auditory icons at the outset of a dialog flow between the user and the application, or 
upon a first activation or instaUation of the application, and the auditory icon 
management unit might store all information regarding the auditory icons and their 

20 associated instructions in a local memory for use at a later point in time. In this way, the 
dialog management system ensures that it has any auditory icon that it might require for 
providing appropriate feedback to the user, regardless of what might arise during the 
dialog flow. 

Alternatively, the dialog management system might first request an 
25 application to supply only the relevant identifying mformation for each auditory icon in 
its set, such as a unique descriptive name or number, and any usage mstractions 
associated with the different auditory icons. The dialog management system might then 
request each auditory icon only as the necessity arises, in order to reduce memory costs. 
The dialog management system might equally decide, on the basis of the precedmg 
30 dialog flow, which type of auditory icon it might require for a particular application in 
the near future, and it might request this auditory icon in advance from the application. 

For an application that does not avail of a pre-defined set of auditory 
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icons, the dialog management system can provide an appropriate set To this end, the 
dialog management system might be able to determine the nature of the application and 
decide on a suitable set of auditory icons, or the user might choose to define the 
auditory icons himself. He might do this by locating a soimd chunk in digital form, for 
5 example by downloading from the internet or extracting a suitable sound chunk from a 
soundtrack or song, or he might record a sound chimk using a recording apparatus and 
communicate the recording to the dialog management system. For example, he might 
record or obtain a recording of a Formula One racing car being driven at speed, transfer 
the recording to the dialog management system where it is stored in a local memory by 
10 the auditory icon management unit, and specify that this sound chunk be played 

whenever an application for providing sports news reports an update about a Formula 
One race. The user might also advantageously use the microphone of the dialog 
management system to record a suitable sound chunk. In a preferred embodiment of the 
invention, the dialog management system is equipped with a suitable interface for 
1 5 connection to a portable memory such as a USB stick, memory card etc., or to any 
external network such as the intemet, for the purpose of locating and downloading 
soimd chunks for use as auditory icons. 

In a particularly preferred embodiment of the invention, the dialog 
management system is able to provide an application with any auditory icons which it 
20 might require. For example, it might be that an application only disposes of one or two 
auditory icons, for example to indicate the start of a process, or to indicate that an error 
has occurred, requiring the attention of the user. However, such a small selection might 
not be sufficient for an intuitive and easily understood dialog flow between the user and 
the application. In this case, the dialog management system might choose a set of 
25 suitable auditory icons from a selection available, and assign these to the application. 
Furthermore, it might be that two or more applications have similar or identical 
auditory icons in their repertoire. To avoid any confusion on the part of the user that 
might arise should both applications be simultaneously active, these auditory icons 
might be modified by the dialog management system in some way, or might be replaced 
30 by different, equally suitable auditory icons. For example, on loading a new application, 
the dialog management system examines the auditory icons associated with the new 
application, and compares them to the auditoiy icons already assigned to the other 
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applications. If any of the new auditory icons is identical or very siinilar to any existing 
auditory icon, the dialog management system preferably informs the user, and suggests 
suitable alternatives if it has any available. If no suitable alternative auditory icons are 
available, the dialog management system might prompt the user to enter suitable 
5 replacements. 

Examples of auditory icons which an application might use to provide 
audible feedback to the user are start auditory icons, to be played when a dialog flow 
between the user and the application is activated or reactivated from stand-by, and end 
auditory icons, to be played when the dialog flow between the user and the application 

10 is concluded, deactivated, or placed in a stand-by mode. The start auditory icon itself 
should reflect the nature of the apphcation, while the end auditory icon might simply be 
the sounds of the start icon, played in reverse order. An application might also use 
informative auditor/ icons, whose sound contains some clue as to the nature of the 
application or the actual feedback type associated with this auditory icon. For example 

15 an application for supplying weather forecast updates might play an auditory icon with 
weather-associated sounds such as wmd for stormy weather, raindrops for rainy 
weather and birdsong for fair weather. Other examples of auditory icons might be those 
used to provide status or information updates during the time that an application is 
active. For example, an application running a personal digital assistant might have 

20 several auditory icons for supplying the user with different types of status feedback 

concerning appointments, incoming emails, due-dates for reports, etc. For example, the 
personal digital assistant might repeatedly remind the user of an upcoming appointment 
using an appropriate audible icon, with the reminders becoming more and more 
persistent as the appointment draws near. 

25 In a preferred embodiment of the invention, the user might specify which 

audible icons of which applications he would like to hear during a dialog flow, by 
entering suitable information into a user profile. He might also specify the loudness of 
the auditory icons, and the number of times an auditory icon is to be played during the 
dialog flow. In addition, he can assign priorities to the various applications, so that 

30 feedback from an intercom takes priority over an application such as a personal digital 
assistant. In this way, the user ensures ttiat he will always be informed of the higher- 
priority application in the event that higher- and lower-priority applications 



9 
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simultaneously report feedback in the dialog flow. The user profile can be consulted 
regularly or after every modification by the auditory icon management unit to 
determine whether an auditory icon should be played back, the desired loudness, and 
the number of times this auditory icon can be played back during this dialog flow. 
5 In a further preferred embodiment, the dialog management system can 

deduce user preferences by interpreting dialog flow. For example, if an application has 
reported a reminder for an upcoming appointment by means of an appropriate auditory 
icon, and the user replies "I know, 1 know", the dialog management system can interpret 
this to mean that the user does not need reminding again, and might suppress the 

1 0 auditory icon for this feedback the next time it is initiated by the application. This level 
of "intelligent" interpretation on the part of the dialog management system might also 
be specified by the user in the user profile. For a dialog management system used by 
more than one user, a number of user profiles can preferably be configured, so that each 
user has his own private user profile in which he can specify his own personal 

1 5 preferences. 

A dialog management system according to the present invention might 
perform some of the processing steps described above by implementing software 
modules or a computer program product. Such a computer program product might be 
directly loadable into the memory of a programmable dialog management system. Some 

20 of the units or modules such as the core dialog engme, application interface unit and r 
auditory icon management unit can thereby be realised in the form of computer 
program modules. Since any required software or algorithms might be encoded on a 
processor of a hardware device, an existing electronic device might easily be adapted to 
benefit from the features of the invention. Alternatively, the units or blocks for 

25 processing user input and the output prompts in the manner described can equally be 
realised using hardware modules. 

Other objects and features of the present invention will become apparent 
from the following detailed descriptions considered in conjunction with the 
accompanying drawing. It is to be understood, however, that the drawing is designed 

30 solely for the purposes of illustration and not as a definition of the limits of the 
invention, for which reference should be made to the appended clainns. 

The sole figure, Fig. 1, is a schematic block diagram of a dialog 
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management system in accordance with an embodiment of the present invention. 

In the description of the figure, which does not exclude other possible 
realisations of the invention, the system is shown as part of a user device, for example a 
home dialog system. For the sake of clarity, the interface between the user and the 
5 present invention has not been included in the diagram. 



Fig. 1 shows a dialog management system 1 with a number of interfaces 
for communicating with multiple external applications Ai, A2, A3, , . 

10 A„. The applications Ai, A2, A3, ...» An, shown in a simphfied manner as 

blocks, can in reality be any kind of "application" or "function" about 
which a user would like to be informed, or which a user would like to 
control in some way. In this example, the applications Ai, A2, A3, . . An 
might include, among others, a personal digital assistant Ai, a news and 

15 weather service A2, and a telephone A3. 



The dialog management system 1 features an application interface 10 for 
handling incoming and outgomg information passed between the dialog management 

20 system 1 and the applications Ai, A2, A3, . . A„. Furthermore, the dialog management 
system 1 can obtain information from each application Ai, A2, A3, . . An regarding any 
auditory icons it might feature, and when these auditory icons should be played. This 
information is stored in an auditory icon management unit 1 L In this example, one of 
the applications Aj might automatically provide the dialog management system 1 with 

25 all relevant information concerning its set of auditory icons, for example when the 
application Ai is started or booted. Another application A3 might only submit 
descriptive information regarding its auditory icons in advance, and submit a single 
auditory icon upon request in the event that the auditory icon is actually required in the 
dialog flow. The dialog management system 1 can request an appUcation Ai, A2, A3, 

30 . . An to provide information regarding one or more auditory icons as required, or 
when the application Ai, A2, A3, . . ., An is started. 

Not all applications will have a complete set of suitable auditory icons at 
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its disposal. Some applications may not have any auditory icons at all, and some 
applications might even have identical auditory icons. To deal with such situations, the 
auditory icon management unit 1 1 can assign auditory icons to an application A2 by 
choosing suitable ones from a collection of pre-defined auditory icons 13. For such an 
5 application, the user might prefer to have the auditory icon management unit 1 1 assign 
a particular soimd recording to the application A2. For example, the user might like to 
hear the sound of birdsong when the weather service A2 reports fair weather. If stormy 
weather is forecast, the user might like to hear the sound of thunder. The user can input 
these recordings as audio data in a suitable format via a user interface 1 5, and have the 
1 0 auditory icon management unit 1 1 assign them to the weather service application A2. 
Another way of supplying the auditory icon management unit 1 1 with such recordings 
is to download them from an external computer or a network 12 such as the internet, via 

a suitable interface 14. 

These different ways of obtaining auditory icon information allow the 

1 5 dialog management system 1 to collect all the information it requires in order to 
playback the relevant auditory icons as required in the dialog flow. 

The dialog flow in this example consists of communication between the 
user, not shown in the diagram, and the various applications Ai, A2, A3, . An driven 
by the dialog management system 1 . The user issues spoken commands or requests to 

20 the dialog management system 1 through a microphone 5. The spoken commands or 
requests are recorded and digitised in an input detection arrangement 4, which passes 
the recorded speech mput to a core dialog engine 8. This engine 8 comprises several 
blocks for performing the usual steps involved in speech recognition - an audio 
interface block 20 performs some necessary digital signal processing on the input 

25 speech signal before forwarding it to an automatic speech recogniser 21. This extracts 
any recognisable speech components from the input audio signal and forwards these to 
a language understanding block 22. In the language understanding block 22, the spoken 
commands or requests of the user are analysed for relevance and passed on as 
appropriate to the dialog controller 23, which converts the user input into commands or 

30 requests that can be executed by the appropriate application Ai, A2, A3, . . An. 

Should it be necessary to obtain some further information from the user, 
for example if the spoken commands can not be parsed or understood by the automatic 



wo 2005/093715 



13 



PCT/IB2005/050956 



speech recogniser 21 and language understanding 22 blocks, or if the spoken commands 
cannot be applied to any of the applications Ai, A2, A3, An that are active, the dialog 
controller 23 generates appropriate requests and forwards these to a speech generator 24 
where they are synthesized to speech. The audio interface block 20 performs the 
5 necessary digital signal processing on the output speech signal which is then converted 
in an sound output arrangement 6 such as a loudspeaker to give audible sound 7. 

In a typical example of a dialog flow controlled by the dialog 
management system of Fig. 1, the user might wish to enter an appointment into the 
diary of his personal digital assistant Ai. All he needs to do is to say "Enter 
10 appointment with tax advisor next Monday at 1 lam". The core dialog engine 8 converts 
the command into the appropriate fomi and submits it to the personal digital assistant 
application Ai. If the appointment can be entered without any problem into the personal 
digital assistant Aj, the appropriate feedback is reported to the dialog management 
system 1 , which chooses the appropriate confirmatory feedback - such as a spoken 

1 5 "OK" or "Roger" - to be output. 

If an appointment is already scheduled for the same time on that day, the 
personal digital assistant Ai reports back to the dialog management system 1, where the 
application mterface 10 and/or the dialog controller 23 interprets the application's 
response, and chooses the appropriate auditory icon - for example the sound of clashing 

20 cymbals to indicate to the user that the new appointment clashes with an appointment 
already entered. Additionally, the dialog controller 23 triggers generation of a suitable 
prompt, e.g. "You already have an appointment at 1 lam with Mr. So-and-so". 
Optionally, the user may deactivate the prompt output if detailed feedback is not 
desired by the user . 

25 In this example, the user has specified his preferences regarding the 

playback of auditory icons in a user profile, to customise or configure the extent to 
which he would like to be informed about events occurring in the applications he uses, 
and which applications are to be accorded a higher priority in the dialog flow. These 
preferences might endure until changed at some later time by the user, or they might be 

30 of a transitory nature. For example, the user might tell the dialog management system 
how to react withm a certain period of time. For example, when the user says "Dorft 
interrupt me for the next two hours unless if s really important", the dialog management 
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system suppresses the reporting of minor events occiirring during the following two 
hours, such as an automatic weather update, and postpones for two hours all relatively 
unimportant events such as 24-hour reminders for upcoming scheduled appointments 
"Dentist tomorrow afternoon at 3pm". The user would only be interrupted by a 
5 relatively important event such as a scheduled appointment during the specified time 
"Meeting with director in 1 5 minutes" or a telephone call from an client tagged in the 
telephone application A3 as being important. The dialog management system decides 
what is important and what is relatively unimportant by examining the information 
specified in the user profile 3. 

10 Other preferences might specify the priority given to the applications if 

two or more applications indicate that auditory icons are to the played at the same time. 
In this case, the user has specified in the user profile 13 that the telephone A3 is to be 
assigned a higher priority than the news and weather service A2. If the news and 
weather service A2 is about to give its automatic news update, and an incoming call 

15 arrives at the same time, the application interface 10 acknowledges that the telephone 
application A3 has the higher priority, and suppresses the auditory icon of the news and 
weather service A2, which may be postponed for output at a later point in time. 

Although the present invention has been disclosed in the form of 
preferred embodiments and variations fliereon, it will be understood that numerous 

20 additional modifications and variations could be made thereto without departing from 
the scope of the invention, for example the auditory icon management unit might be 
realised as part of the core dialog engine, or be incorporated in another module such as 
the dialog controller. In one embodiment of the invention, the dialog system might be 
able to determine the quality of the current user's voice after processing a few 

25 utterances, or the user might make himself known to the system by entering an 

identification code which might then be used to access stored user profile information 
which in turn would be used to generate appropriate control parameters for the audio 
interface. 

For the sake of clarity, throughout this application, it is to be understood 
30 that the use of "a" or "an" does not exclude a plurality, and "comprising" does not 

exclude other steps or elements. The use of "unit" or "module" does not limit realisation 
to a single unit or module. 



